Applicant : Stephen K. Pinto et aL 



Attorney's Docket No.: 17146-007001 



Serial No. : 10/826,630 
Filed : April 16,2004 
Page : 2 of 15 



Amendments to the claims (this listing replaces all prior versions): 

1 . (Currently amended) A machine-based method comprising 
in connection with a project in which a user generates a predictive model based on 
historical data about a system being modeled: 

selecting variables having at least a first predetermined level of significance from a pool of 
potential predictor variables associated with the data, to form a population of predictor variables, 

extending the population of predictor variables to include non-linear interactions of variables, 

extending the population of predictor variables to include linear and non-linear extensions 
with remaining previously excluded variables, 

automatically selecting - a model generation method from among a set of availabl e model 
generation methods to match characteristics of the historical data, 

generating a possible model of the extended population of variables using a subsample of the 
data by the model generation method , 

determining whether the possible model generalizes to the data other than the subsample, 

*£s% applying the possible model to all of the data to generate a final model, m& 
cross-validating the final model using random portions of the dat a, and [[.Tj 

interacting with the system being modeled based on the final model 



user of the size of the pool of predictor variables. 

3. (Currently amended) The method of claim 1 also including enabling a user to 
point and cl ick to reduce or extend the size of the pool of predictor variables, retaining only the 
most sigpifie mt-predictor variables having at least a second predetermined level of significance . 




2. 



(Original) The method of claim 1 also including displaying information to the 
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4. (Currently amended) The method of claim 1 in which the user is enabled to 
invoke an automatic process to select a class of models most suitable to the pool of predictor 
variables fer4he~associated dataset with the data . 

5. (Currently amended) The method of claim 1 in which the user is enabled to point 
and click to adjust the model selection criterion to retain only the m os t p o t e nt variables having at 
least a third predetermined level of significance for the target goal. 

6. (Original) The method of claim 1 in which the user is enabled to point and click to 
cause display of information about the model performance. 

7. (Currently amended) The method of claim 6 in which the information about the 
model performance includes at least one of: a statistical report card^ with a link to the a statistical 
report chart, a lift chart, with a link to the lift chart, a response comparison chart for each decile 
for each predictor variable in the model, and or a link to the response comparison chart. 

8. (Original) The method of claim 7 in which invocation of the link to the statistical 
report card causes display of the statistics of model performance. 

9. (Original) The method of claim 7 in which invocation of the link to the lift chart 
causes display of a non-cumulative lift chart. 

1 0. (Original) The method of claim 7 in which invocation of the link to the response 
comparison chart causes display of a response chart for each predictor variable in the model for 
each segment of interest. 
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1 1 . (Currently amended) The method of claim 1 in which a user is enabled to choose 
interactively at least one performance criterion change or transformation or interaction of 
variables to improve the a fit of the model. 

12. (Currently amended) The method of claim 1 also including a enabling a 
determination whether the model generalizes to the data other than the subsample, and, if so, 
applying the possible model to all of the data to generate a final model, and cross-validating the 
final model using random portions of the data. 

13. (Original) The method of claim 12 in which the user is enabled to select at least 
one validation dataset and invoke a model process validation method. 

14. (Original) The method of claim 12 in which the user is enabled to point and click 
to cause display of information about the model process validation. 

15. (Currently amended) The method of claim 12 in which the information about the 
model process validation includes at least one of: a statistical report card,, with a link to tha a 
statistical report chart, a cumulative lift chart, with a link to the cumulative lift chart, a non- 
cumulative lift chart, with a link to the non-cumulative lift chart. 

16. (Original) The method of claim 1 in which the user is enabled to select at least 
one machine automated model development process applied to the entire dataset for a validated 
model process. 

1 7. (Original) The method of claim 1 in which the user is enabled to point and click to 
cause display of information about the performance of the validated model process applied to the 
entire set of historical data. 
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1 8. (Currently amended) The method of claim 1 7 in which the information about the 
model performance for two independent data subsets , the independent data subsets being 
randomly selected from the historical data, includes at least one of: a statistical report card* with 
a link to the a statistical report chart, a cumulative lift chart A with a link to the cumulative lift 
chart, a non-cumulative lift charts with a link to the non-cumulative lift chart. 

1 9. (Original) The method of claim 1 8 in which the invocation of the link to the 
statistical report card causes display of the statistics of model process validation. 

20-21. (Cancelled) 

22. (Original) The method of claim 1 8 in which the final model and the model 
process validation results are stored persistently. 

23. (Original) The method of claim 1 also including enabling the user to observe the 
number of predictor variables available for the model. 

24. (Currently amended) The method of claim 1 in which a model method from a 
library of model methods most suitable to modeling the historical data set is automatically 
selected. 

25. (Original) The method of claim 1 also including enabling the user to observe the 
performance of the model by means of links to a plurality of statistical and graphical reports. 

26. (Original) The method of claim 1 also enabling the user to select a means of 
validating the model development process. 
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27. (Currently amended) The method of claim 1 also enabling the user to observe the 
performance of the model for the a training subset and a validation s ubsets subset of the 
historical dataset- data . 

28. (Currently amended) The method of claim 1 also enabling the user to invoke at 
least one validated model development process to produce a final model enabling the use user to 
observe the performance of the final model on at least two independent subsets , the independent 
subsets being randomly selected from the historical data . 

29. (Currently amended) The method of claim 1 enabling the persisting of the final 
model and intermediate results to the a project database. 

30. (Original) The method of claim 1 enabling the final model to be applied to scoring 
at least one non-historical dataset wherein the propensity computed by the model is indexed by 
the score. 

3 1 . (Currently amended) A machine-based method comprising 
in connection with a project^ 

automatically selecting a model generation method from among a set of available model 
generation methods to match characteristics of historical data about a system being modeled, 
in which a user g e n e r a tes generating a predictive model based on the historical data abeut-a 
sy s tem being modeled , 

displaying to a user a lift chart, monotonicity, and concordance scores associated with 
each step in a step-wise model fitting process. 

32. (Original) The method of claim 3 1 also including enabling the user to observe 
changes in the fit of the model as variables associated with the data are added or removed from a 
predictor set of the variables. 
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33. (Original) The method of claim 3 1 also including enabling the user to terminate 
the fitting of the model when the fitting process reaches an optimal point. 

34. (Currently amended) A machine-based method comprising 

receiving from separate sources, sets of potential predictor and dependent variables 
representing historical data about a system being modeled, and 

enabling a user of a model generation tool to combine at least two of the dependent 
variables from the sets of potential predictor and dependent variables to generate a model to be 
used in interacting with the system being modeled . 

35. (Original) The method of claim 34 in which enabling the user to combine the 
variables includes providing a user interface that enables the user to identify the variables to be 
combined. 

36. (Currently amended) The method of claim 34 in which the system being modeled 
comprises behavior of prospective or current customers with respect to products or services of a 
company and the method also includes adjusting outcome variables to normalize response rates 
across products or services with different response rates. 

37. (Currently amended) The method of claim 34 in which the system being modeled 
comprises behavior of current customers with respect to retention of a current service or product 
of a vendor and the method also includes adjusting variables to normalize response rates across 
products or services with different response rates, using the computed propensities as indices of 
the scores. 

38. (Currently amended) The method of claim 31 also comprising determining a 
course of action to yield the most positive NPV net present value outcome. 
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39. (Original) The method of claim 38 in which the determining includes selection of 
a mix of channel and product combinations. 



40. (Currently amended) The method of claim 3 8 in which the determining includes 
predicting retention in combination with response rate to predict NPV net present value . 



